You're The Conductor: A Realistic Interactive Conducting System for Children
نویسندگان
چکیده
This paper describes the first system designed to allow children to conduct an audio and video recording of an orchestra. No prior music experience is required to control the orchestra, and the system uses an advanced algorithm to time stretch the audio in real-time at high quality and without altering the pitch. We will discuss the requirements and challenges of designing an interface to target our particular user group (children), followed by some system implementation details. An overview of the algorithm used for audio time stretching will also be presented. We are currently using this technology to study and compare professional and non-professional conducting behavior, and its implications when designing new interfaces for multimedia. You’re the Conductor is currently a successful exhibit at the Children’s Museum in Boston, USA.
منابع مشابه
On the Origin of Transport Non-Universality and Piezoresistivity in Segregated Conductor-Insulator Composites and Application to Thick-Film Resistors
In this thesis we address the description of electrical transport properties of disordered conductor-insulator composites, mostly by numerical Monte Carlo simulations and analytical study of realistic tunnelling-percolation models. Such composites are basically constituted by conducting particles dispersed in an insulating matrix and present a conductor-insulator phase transition, with critical...
متن کاملGesture-Driven Interaction Using the Leap Motion to Conduct a 3D Particle System: Evaluation and Analysis of an Orchestral Performance
In this work, we present and evaluate an interactive simulation of 3D particles conducted by the Leap Motion, for an orchestral arrangement. A real-time visual feedback during gesture entry is generated for the conductor and the audience, through a set of particle emitters displayed on the screen and the path traced by the captured gesture. We use two types of data input: the captured left and ...
متن کاملPersonal Orchestra: Conducting Audio/Video Music Recordings
Personal Orchestra lets anybody conduct an electronic orchestra at a new level of realism: users interact not with a synthetic, but an original audio and video recording of a real orchestra—the Vienna Philharmonic. Nevertheless, they can interactively control not only volume and instrumentation, but also tempo of the orchestra, using natural conducting gestures. A gesture-tracking and -predicti...
متن کاملA real-time audio/video system for interactive conducting
We present the first multimedia system to conduct a realistic electronic orchestra. Users can control tempo, dynamics, and instrument emphasis of the orchestra through natural conducting gestures with an infrared baton. Using gesture recognition and tempo adjustment algorithms, the system plays back an audio and video recording of an actual orchestra that follows the user’s conducting in real t...
متن کاملDetecting Audio-Video Tempo Discrepancies between Conductor and Orchestra
Tempo perception has been studied using many different methodologies in trying to isolate the motion patterns of a conductor in experimental stimuli. In doing so, the context of conducting has been ignored including secondary bodily motion, expression and communication from the conductor, and conducting gestures outside of the realm of tempo control. The aim of this study is to test the ability...
متن کامل